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We study a well known machine learning model -the perceptron- as a simple model of jamming of 
hard objects. We exhibit two regimes: 1) a convex optimisation regime where jamming is hypostatic 
and non-critical. 2) a non convex optimisation regime where jamming is isostatic and critical. We 
characterise the critical jamming phase through exponents describing the distributions law of forces 
and gaps. Surprisingly we find that these exponents coincide with the corresponding ones recently 
computed in high dimensional hard spheres. In addition, modifying the perceptron to a random 
linear programming problem, we show that isostaticity is not a sufficient condition for singular 
force and gap distributions. For that, fragmentation of the space of solutions (replica symmetry 
breaking) appears to be a crucial ingredient. We hypothesise universality for a large class of non- 
convex constrained satisfaction problems with continuous variables. 

PACS numbers: 63.50.Lm,45.70.-n,61.20.-p,64.70.kj 


Introduction- Jamming of hard objects is a general 
phenomenon that has attracted lot of interest, both ex¬ 
perimental and theoretical, (see [l], Q for recent reviews). 
Jamming of hard spheres, where the only interaction is 
excluded volume, has been widely studied: the jamming 
point is reached when, both under equilibrium or off- 
equilibrium conditions, the size of the cages where the 
particles can move shrinks to zero. In this limit the sys¬ 
tem is critical: the network of contacts is isostatic |J. 4j, 
and many quantities have an anomalous power behaviour 
with non-trivial critical exponents HH3- While local ex¬ 
citations give rise to exponents that may depend on the 
spatial dimension Q, the contributions of long range 
excitations appear to be super-universal: numerical sim¬ 
ulations show that upon removing the contributions of 
local excitation, the critical exponents have a very weak 
dependence on the space dimension in wide range of di¬ 
mensions 13 , 111. Moreover, these exponents seem to be 
independent from the protocol used to generate jammed 
configurations. In the infinite dimensional limit one 
expects some simplifications to be present and one can 
study analytically jamming at equilibrium. Indeed (if we 
disregard crystallisation) the thermodynamics of a gas of 
thermal hard spheres can be solved when the dimension 
goes to infinity fl2l4l5| . One finds a rather unexpected 
scenario: 

At low pressure (low density) we stay in the liquid 
phase. Increasing the density at a pressure P g we enter 
into the glass phase where the spheres are confined into 
small volume cages. 

Further increasing the density, at a high pressure Pq 
we enter into a different glass phase where the cages split 
into smaller cages when increasing the pressure. This 
process goes on up to infinite pressure. 

In the infinite pressure limit one finds analytically the 
power laws that have been discovered in [jfl, [lg, [l7|: the 


exponents can be computed and they are compatible 
(within the numerical bounds) with the exponents found 
in dimensions from 2 upwards. 

From an abstract viewpoint the problem of packing 
spheres in space can be viewed as a constraint satisfac¬ 
tion problem where one aims to maximize the sphere’s 
packing fraction subject to the hard core impenetrability 
constraints. Statistical physics has been instrumental in 
the analysis of random constraint satisfaction problems, 
where the constraints on the variables are chosen at ran¬ 
dom from an ensemble: by changing the number or the 
nature of the constraints we go from a satisfiable (SAT) 
phase (where there is at least one configuration that sat¬ 
isfies all the constraints) to an unsatisfiable (UNSAT) 
phase (where it is impossible to satisfy all the constraints 
at the same time). Usually this SAT-UNSAT transition 
becomes sharp in the thermodynamic limit: with the ex¬ 
clusion of the transition point, the probability of a ran¬ 
dom problem to be satisfiable becomes 0 or 1 in the ther¬ 
modynamic limit where the number of the variable of the 
systems ( N ) and the number of constraints (M) goes to 
infinity at fixed ratio a = M/N. Random constraint sat¬ 
isfaction problems have been widely studied by physicists 
in the case of discrete variables: the most celebrated case 
is the random K-SAT problem H3 , where the physicist’s 
solution has been recently proved for sufficiently large K 
0. Polydisperse hard spheres [0 are a P a rticular case 
of random constraint satisfaction problem, but they dif¬ 
fer from the mostly studied cases by the nature of the 
variables which are continuous rather than discrete. The 
continuous nature of the variables adds a new dimension 
to the the problem: the SAT-UNSAT transition coin¬ 
cides with an equilibrium jamming transition where the 
volume of the space of the satisfying assignments of vari¬ 
ables shrinks to zero and the system can become critical. 

The infinite dimensional limit of hard spheres is the 
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first example of non-trivial continuous constraint satis¬ 
faction problems that has been analytically solved. One 
may wonder how much general is the critical picture of 
the jamming transition, and if criticality there is, if a 
unique or several universality classes are possible. The 
aim of this letter is to present a simple model of jamming, 
that can be solved analytically and it has the same jam¬ 
ming exponents of hard spheres. The model, the spher¬ 
ical perceptron, is very well known in machine learning 
and neural network theory, where it is used as linear sig¬ 
nal classifier [ 21 ]. 


A toy sphere packing problem We start from an ex¬ 
treme schematisation of sphere jamming problem in 
which we substitute the interaction between spheres with 
a random background and consider a single particle that 
should not overlap with some spherical obstacles placed 
in random positions in space. Both the obstacle and the 
single particle live on Sjv, the N dimensional sphere of 
radius y/N. Let us consider M = aN point obstacles 
[i = n = 1 , in fixed random positions 

on the N dimensional sphere, and a particle at Xi con¬ 
strained to be at a distance greater than cr from the ob¬ 
stacles: |£ M — x| > a. As we shall see this problem is 
isomorphous to the perceptron. 


The perceptron - Also in this case the configuration 
space is the sphere Sjv of normalised A-dimensional vec¬ 
tors x such that Xw=i n x i = We impose the fol¬ 
lowing M = aN constraints: we have M Wdimensional 
random vectors ^ (with the same normalisation) and we 
require that 


= K>0 V/r = l,...,M. (1) 


The quantities r^ will be called gaps in the following. 
In a packing perspective we see that the problem of the 
toy spheres coincides with the perceptron for a 2 = 2N + 
2k. The analogue of packing fraction maximisation in 
the problem of hard spheres is here maximisation of k 
for fixed a. While in machine learning the interest is 
generally restricted to the positive values of k (see [ 22 ] for 
an exception), for the jamming problem negative values 
are equally legitimate and, we will see, more interesting. 
In the a-K plane there is a SAT region where the previous 
inequalities have at least one solution (with probability 
one) and an UNSAT region where there is no solution. 
The line of jamming points that separates the two regions 
has the shape shown in fig. 1. The value of a c (K) on this 
line is usually called the maximum perceptron capacity 
in machine learning. The perceptron problem has been 
studied in the past with statistical physics approaches 
s [j3 ] and the results of Gardner and Derrida for k > 0 
are well know: defining D^y the Gaussian measure with 
zero average and variance a 2 ( Dy = Diy), and the error 


function H(x) = J^° Dy , we have 

cc c (re) = (/ Dh(h — n)‘ 


( 2 ) 


The distribution of the gaps g{r) at jamming, that we 
normalize to the ratio of the number of constraints over 
variables a, is given by 

g(r) = a(l — Lf(re))i5(r) H — f)_ e -( r + K ) ! 2 0{r ). (3) 

v 27T 

According to equations (ED), for k > 0 the system is ’hy¬ 
postatic’: the weight of the delta function contribution in 
(|3|) gives precisely the fraction of binding constraints in 
the system, for which © is verified as an equality. This 
is a decreasing function of k, smaller than one for k > 0 
and equal to one exactly at n — 0. Notice that the r > 0 
part of the distribution is regular and has a finite limit 
for r —> 0. These results contrast with salient features 
of jamming in hard spheres: the property of isostaticity 
and the presence of a power law singularity in the gaps 
distribution at small r Si- 

However these formulae are valid only for positive or 
zero k (a(0) = 2). In this situation, for any a < a c (n) the 
space of allowed configurations is convex on the sphere 
(it is the intersection of convex domains) and the sit¬ 
uation is well under mathematical control [22, 251. The 
case of negative k is much harder, each constraint defines 
a non-convex allowed domain and the space of solutions 
can fragment in disconnected regions. In the statisti¬ 
cal approach that we are going to describe below, this 
phenomenon corresponds to replica symmetry breaking, 
while the previous formulae have been derived in a replica 
symmetric assumption. We will show that as soon as 
k < 0 replica symmetry is broken and critical universal¬ 
ity at the jamming point emerges, the system is isostatic 
(i.e. the number of contacts is equal to the dimension 
of the space, i.e. N ), g(r) displays a power law singu¬ 
larity g(r) ~ r -7 at small r, which is in turn associated 
to a pseudo-gap in the force distributions P(F) ~ F e 
at small F. With an argument analogous to the one 
used in hard spheres Q, one can show (see SM) that 
the exponents verify the stability bound 7 > 1/(2 + 9). 
The arguments of [26[ can be used to argue that stability 
should be marginal and this inequality saturated. The 
values we find 7 = 0.41269 and 9 = 0.42311 indeed satu¬ 
rate to numerical precision the bound and they coincide 
with the ones found in high dimensional hard spheres. 

In order to study the model it is convenient to intro¬ 
duce an Hamiltonian Ti(x) that is non zero only if all the 
constraints are violated. A choice analogous to the soft 
sphere Hamiltonian is 


^0) = ^X>^(r M ), 
1 


( 4 ) 
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where 6 is the standard Heaviside function. In the follow¬ 
ing we will concentrate mainly on analytic computation 
of the Gardner volume [23| of the satisfying assignments 


y.N 


V(a,re) = e NS{a ’ K) = 


/ Sn 


dx 0 (r>) 


( 5 ) 


M= 1 


The equilibrium jamming transition line is the locus of 
points where this volume shrinks to zero, and we will 
approach it from the SAT phase. To test our theoretical 
findings, and show that also in the perceptron the critical 
properties of jamming are independent of the preparation 
of the jammed configurations, we will also present nu¬ 
merical simulations, where we generate non-equilibrium 
jammed configurations through local minimisation of T~L. 
It is important to distinguish equilibrium jamming tran¬ 
sition from off-equilibrium jammed configurations gener¬ 
ated with heuristic minimisation algorithms. These last 
can be defined as isolated points of minimum of T~L with 


n = 0 . 

The Gardner Volume The quenched average of the 
entropy S(a,n) over the random vectors £ /J can be per¬ 
formed with replicas. Alternatively the more tr ansp arent 
but cumbersome cavity method could be used [27|. Fol¬ 
lowing standard computations, see e.g. [28], one finds [23] 
that the entropy can be expressed as a saddle point over 
the overlap matrix between solutions in different replicas 
Qa,b = N _1 Y^i( x i x i) where a, b = 1 ,..., n with n —> 0 at 
the end 0 : 


nSfQ] = l/2tr log Q 


( 6 ) 


a log 


h X ]ab Q a 


bdh a dhi 


' - K) 


h a — 0 


Assuming that the replica symmetry is broken in the 
usual hierarchical ultrametric way |28| . one gets an ex¬ 
plicit form of the entropy that we report for reader con¬ 
venience. First of all, using the parameterization the 
matrix Q in terms the function x(q) which varies in an 
interval [go,gi] [ 13 ], we have 

-tr log Q = log(l - «i) + tt\ + I" 1 TTT ( 7 ) 
n X(qo) J qo A (g) 

A (q) = 1 - qi + f dq' x{q'). ( 8 ) 

Jq 


Secondly, the remaining term in the entropy, can be 
written as —na f D qo (h — re)/(go,/i), where, indicating 
with dots g-derivatives and with primes h-derivatives, the 
function /(g, h) verifies the partial differential equation 

& 


f = ~l(f"+ x f' 2 ) ( 9 ) 

with boundary condition 

f{qi,h) = - log H . ( 10 ) 


As usual, in order to write the variational equations for 
x(q) it is useful to define the distribution of the local gaps 
at level q: P(q , h) which verifies [31, 32 1 

P = ^{P" - 2x(mP)') ; P(q 0 ,h) = D qo (h)/dh,( 11) 

where we introduced m(q, h) = f'(q, h) that verifies 


fn = ——(m" + 2xmm'). 


( 12 ) 


The variational equations with respect to x(q) read 



a 

2 


dh Pm 2 = 0.(13) 


The RS solution is recovered from the above formulation 
in the limit gi = go. If there is a continuous part in x(q) 
it is useful to consider the derivatives of the (fl3l) w.r.t. g 


1 

2%F 


a 

2 


dh Pm' 2 = 0 . 


(14) 


which, as it is well known, signals that continuous RSB 
solutions are marginally stable with a divergent spin glass 
susceptibility. In any discontinuous solution, stability re¬ 
quires positivity of the l.h.s. of (fill) . For each value of k 
at sufficiently low values of a the system is in the replica 
symmetric “liquid” phase: the space of SAT assignments 
is simply connected and one can go with continuity from 
one solution to the others. At higher values of a replica 
symmetry breaks down and the space of solution becomes 
disconnected. The line of transition for « < 0, along 
with the jamming line estimated from the RS solution, 
are presented in fig. 1. The RSB transition occurs in the 
SAT phase for re < 0, and as announced, the jamming 
line lies in the glassy RSB phase. Generically, the RSB 
solution space fragmentation can occur either through a 
second order transition to a continuous RSB phase or 
through a discontinuous Random First Order Transition 
[28j |. Close to re = 0, and down to re = kirsb ~ —2.05 
one finds RSB to a continuous solution occurring via a 
de Almeida-Thouless [33| instability of the RS solution. 
Below the value h\rsb one finds a transition to a discon¬ 
tinuous “one step” solution. It is important to remark 
however, that upon increasing re at fixed a so to approach 
jamming, a second transition to a continuous solution, 
the so called Gardner transition should be expected, so 
that for all re < 0 jamming is described by a continuous 
solution. 

Jamming The jamming transition is the point where 
the space of solutions shrinks to a point, the entropy 
goes to — oo, and the solution’s self-overlap gi —> 1. In 
this conditions, the boundary condition (fTOl) for / in gi 
reduces to 

qi ^ 1 ' (15) 

As for jamming in spheres or for the low temperature 
limit of the SK model, we can expect a scaling regime 
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FIG. 1. Phase diagram of the model. The de Almeida- 
Thouless (AT) line of instability of the RS solution in the 
(x — k plane (red line), together with the jamming line (blue) 
as estimated from the RS solution. The jamming line is ex¬ 
act for k > 0 while corrections are to be expected for k < 0 , 
where the RS solution just provides an upper bound to the 
true value [ 2 jj ]. 


to emerge where all the relevant values of q are close to 
unity. The existence of the scaling regime is intimately 
related to the behaviour of the distributions of the small 
gaps and forces g{r) ~ r -7 and P(F) ~ F e . As de¬ 
scribed in more detail in the SM, the scaling regime can 
be studies solving first the equations for P and m for 
large positive and negative values of h, and then match¬ 
ing both regimes via scaling functions A~ a ^ k p\{hA~ 1 / 2 ) 
and j^rmihA- 1 / 2 ) where A = 1 — q. The exponents 
a, and k are determined from the explicit solution to the 
equations. It turns out that pi satisfy the same equa¬ 
tion and boundary conditions of the analogous function 
that appears in the hard sphere problem, and that there¬ 
fore, scaling function and exponents are the same to this 
case. The difference between the two cases comes in the 
distributions of gaps and forces at large values that are 
non-universal. 

The behaviours of p\ (u) at large positive and negative 
argument are related respectively to the small gap and 
the small force distributions and behaves as 


Pi{u) 


u 7 u oo + 
\u\ e u —»• oo~ 


(16) 


with 7 = 2 a/k = 0.41269, 9 = = 0.42311. The 

relation 7 = 1/(2 + 9) is verified within numerical errors 
and isostaticity holds. 

A simple variant: random linear programming Our 
results are quite surprising, the jamming transitions in 
the perceptron and in hard spheres, which are rather dif¬ 
ferent problems are in the same universality class. Both 
in the high dimensional spheres and in the present case, 
isostaticity as well as the singular behaviour of the gap 


and force distribution at small argument appear as non¬ 
trivial consequences of the full-RSB solution to the prob¬ 
lem. It is therefore natural to ask if RSB is a neces¬ 
sary ingredient, if isostaticity and power laws are always 
associated or there are models where isostaticity hold 
while the system remains replica symmetric, and if in 
this case the singular behaviour in g and P is found. To 
address these questions we slightly modify the problem 
CD- On the one hand we relax the spherical constraint 
on x, which then becomes a vector of N real variables, 
on the other we modify the constraints to: 

+ ^ ~ K> 0 = ( 17 ) 

where, as before the are vectors on the sphere and 
we introduced new constants that we take as Gaus¬ 
sian numbers of zero average and variance a. The max¬ 
imisation of k, and the simultaneous determination of 
the maximiser vector x is a linear programming prob¬ 
lem which is convex for all values of a. For a < 2 and 
all k the constraints define an open region of space 
and no finite maximum for n exist. We concentrate then 
on a > 2 where the constraints define a closed region of 
space and a maximum k exists. The analysis of the Gard¬ 
ner volume for this model is very similar to the one of the 
perceptron (see SM) with the important difference that 
here replica symmetry always holds. Remarkably, the 
RS solution is marginally stable and isostaticity holds. 
It seems a general property that isostaticity is associ¬ 
ated to marginal stability of the replica solution, but as 
this example shows, not necessarily to replica symme¬ 
try breaking. However, differently from the perceptron 
for negative k, the distribution g(r) is regular and finite 
at r = 0. We conclude that singular behaviour of the 
distributions and fragmentation of the space of allowed 
configurations are intertwined phenomena. 

Simulations - In order to check the soundness of 
these predictions we have performed the following numer¬ 
ical experiment. We have started from a random config¬ 
uration at a = 3 and we have found a minimum of the 
Hamiltonian 0 in the UNSAT region n > K c (a), and 
we have then approached the jamming point decreasing 
the value of n until the point where the energy is about 
1CT 12 . We obtain in this way a jammed configuration 
with k = n* ss —0.431 (the value we obtain slightly de¬ 
pends on the search procedure). Notice we did not try to 
equilibrate the system: the jammed configuration that 
we reach can be expected to be different from the one 
computed analytically studying the Gardner volume and 
k* < re c (3). We can however study the probability distri¬ 
bution of the gaps and of the forces in the configurations 
found in this way. We have done this analysis for moder¬ 
ate values of N (in the range 50—400), and found that for 
both quantities the distributions at small values are com¬ 
patible with the thermodynamical predictions. This is 
same qualitative coincidence of exponents in equilibrium 
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FIG. 2. The distribution of forces at jamming for a = 4 and 
N = 50,100, 200, 400 in a log-log scale. The straight line is a 
one parameter fit of the kind P(f) = af 8 with the predicted 
value of 9 = 0.42311. 


and off-equilibrium that is observed in the field distribu¬ 
tion of SK model at zero temperature mm and in hard 
spheres. The data of best quality are these for the force 
distribution and are presented in figure (0. We also sim¬ 
ulated in a similar way the random linear programming 
model, where thanks to convexity the limit of thermody¬ 
namic jamming can be readily reached, and we find force 
and gap distributions in perfect agreement with the RS 
predictions with no singularity at small argument. 

Conclusions - The most important results of this let¬ 
ter could be summarised as follow: jamming in the per- 
ceptron is hypostatic and stable in the region k > 0 where 
it defines a convex optimisation problem, conversely in 
the non convex region k < 0 it is isostatic and marginally 
stable. Remarkably jamming is in the same universality 
class as hard spheres. The salient feature of jamming 
of a singular behaviour of the gap and force distribution 
appears to be critically related to fragmentation of the 
space of configurations -continuous RSB- and the exis¬ 
tence of a scaling solution with q ss 1 on approaching the 
jamming line. The random linear programming problem 
shows that isostaticity is not necessarily associated to 
that behaviour. One finds there a jamming line which 
is isostatic and marginally stable which remains however 
Replica Symmetric, and the gap and force distributions 
are regular at small argument. On the bases of these find¬ 
ing we formulate the conjecture that universal jamming 
behaviour occurs in a large class of non convex continu¬ 
ous random CSP with inequality constraints. This could 
be tested e.g. generalising the perceptron problem to 
correlated positions of the obstacles or restricting the 
range of allowed values of the to finite intervals or also, 
considering diluted perceptrons where for each given /j, 
only a finite number of are allowed to be non-zero etc. 
It could also be interesting to see if the universality ex¬ 


tends to systems with constraints of a different nature, 
e.g. where the number of non-zero Xj in each constraint 
is finite. It has been argued in |26| that isostaticity 
gives rise to infinite correlations, and that for this reason 
at jamming hard spheres behave under stress as a system 
with long range forces. Our hypothesis suggests that this 
could be the case for a large class of systems. 

The perceptron is an extreme limit of the hard sphere 
problem in infinite dimensions where all the particles ex¬ 
cept one are pinned in random positions. It is known 
that in low dimensional hard sphere systems the expo¬ 
nents are independent of the fraction of pinned particles 
[3(1 ]. One of the interests of the perceptron is that it is 
a much simpler model than hard spheres -even in the in¬ 
finite dimensional limit-. The derivation of the replica 
effective action is much more direct and the study with 
the cavity method would be straightforward. Though the 
connection of this model with jamming had never been 
underlined before, a lot is known on the model even at 
the rigorous level. Many questions that one could ask 
about jamming could be answered more easily in this 
context than in the hard spheres. Our present interests 
include the computations of spectrum of vibrational nor¬ 
mal modes at small temperature and the low temperature 
specific heat in a quantum version of the model. This is 
technically feasible: more surprises are to be waited. 
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SUPPLEMENTARY MATERIAL 


The de Almeida-Thouless line - The line of instabil¬ 
ity of the replica symmetric solution can be determined 
from the conditions that a) the RS value of the overlap 



FIG. 3. Value of the overlap q and of the breaking point x c on 
the dAT line as a function of k. As long as ft < 0, the value 
of q at the RSB transition is less than unity and RSB occurs 
in the SAT phase. In the interval [ftiftss, 0] the transition is 
continuous. Below that value (not shown) a Random First 
Order transition is to be expected 


q is solution of the saddle point equation, b) the l.h.s. 
of eq. ED, which should be positive in a stable solu¬ 
tion, vanishes on the line, c) the RS solution coincides 
with a degenerate RSB solution with <?o = qi = q and 
the “breaking point” x c = lim gi ^ g x(qi) lies in the in¬ 
terval [0,1]. The breaking point x c can be computed 
from m- Consistency requires x c < 1; if x c so iden¬ 
tified is x c > 1, this is a signal that a 1RSB transition 
occurs before the RS solution becomes unstable. In fig. 
1 we show that full RSB transition occurs in the range 
0 > k > Ki rs b « —2.05 where x c < 1, for ft < K\ rs b the 
found value is x c > 1 and a 1RSB -or random first order 
transition- can be expected. 

Asymptotic solution close to jamming In order to 
characterise the scaling regime close to jamming, where 
1 — qi —> 0, let study first the solution to the equations 
(I11I12D for large values of \h\ and consider the equation 
for m first. For large negative h one can assume a form 
m(q, h) = — ’ which inserted into gives 

f{q) = - x(q ). (18) 


The solution that respects the condition in q\ is r(q) = 
A (q). On the other extreme, for h —> +00 one trivially 
has m(q, h ) = 0. Let us now study the equation for 
P(q,h). For large positive h, one just have a diffusion 
equation, and since for g —>■ go P(qo, h ) = D qo h/dh 1 then 
P(g, h) = D q h/dh , which tends to a Gaussian with unit 
variance for q —> 1. For large negative h on the other 
hand, it is simple to show that P(g, h) must have the form 

P(q,h) = B(q)e~ A( - q ^. The factors A and B should 
verify: 


li_5_ A x 
2 A ~ B ~ ~ 1 + A' 


( 19 ) 
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In order to solve these equations to the leading order, 
we should know something more about the behaviour 
of the function x(q). We are interested to the scaling 
regime when 1 — q\ -C 1. Since x(q) is the weight of the 
overlap lower than q one can expect it to go to zero in 
the jamming limit, we therefore write 


with boundary conditions 


Pi(z) 


z e z ->• +oo 
z -7 z —> —oo 


mi(z) 


0 z —> +oo 
—2 z —> —oo 


(26) 

(27) 


x{q) = X\ ( 2 °) 

with 1 — qi <C x\ -C 1 , where 

Hq) ~ J x(q) tv YZjx(q )A ( 21 ) 

and we denoted A = 1 — q. In this regime, supposing 
self-consistently 2/k > 1 , we can solve the equations (fl9l) 
supposing that A <C x/X ~ In this case, we find 
A(q) ~ A _2+2 / k and B(q) ~ a ~ 1 + 1 / k _ We conclude 
that P and m behave respectively as P(q,h) tv p 2 (h ) 
is approximately independent of q, and m(q, h) tv 0 
for large positive h while P(q,h) tv p 0 (hA~ c / k )A~ c / k 
with c = k — 1 and m(q,h) tv — h/\{q ) for large nega¬ 
tive h. These regimes should be matched by functions 
A~ a / k pi(hA~ b / k ) (with a < b) and ^-m 1 (hA~ b / k ). 
Notice that the in the jamming limit q —> 1, 

P(q, h) -»• A6(h) + p 2 {h) ( 22 ) 

with A = J du po(u). Apart for the (5-function term, 
p 2 (h) is the physical distribution of the gaps at jamming 
and should scale as p 2 {h) ~ ft -7 at small argument. We 
notice at this point that for q —> 1, eq. (fldll reduces to 

l = a f dh po(h) (23) 

J — OO 

which gives A = 1/a i.e. the condition that the sys¬ 
tem is isostatic. Generalising the thermodynamic calcu¬ 
lation to compute the ground state energy slightly above 
jamming, for k > K c (a), one sees that, apart from a 
multiplicative constant, the negative part of the distri¬ 
bution, Po(-.f) can be identified with the force distri¬ 
bution [141 ]. We can therefore assume a power scaling 
Po(u) ~ \u\ e at small argument, to be matched with 
the behaviour of pi{z) at large negative z, analogously, 
the behaviour p 2 {h) ~ |h | -7 at small positive argument 
should be matched with the behaviour of pi for large pos¬ 
itive z. Consistency requires that 9 = tEt> c = k — 1, 
7 = a/b and b/k = 1/2. We find at this point the remark¬ 
able result that the equations and boundary conditions 
that determine pi and mi coincide with the correspond¬ 
ing ones in the case of jamming of hard spheres. Writing 
them explicitly we have: 

|pi + \zPi = \ ( P'i + 2|(m 1 p 1 )') (24) 

(| - \) m i + \ zm 'i =~\ ( m i + 2|m 1 mi) (25) 


In addition the solution should verifies 

J dup\(u) [(k — 1 )toi(w ) 2 (1 + m'(u)) — km'{(u) 2 ] 

= 0 (28) 

that follows from eq. da and its derivative w.r.t. q in 
the scaling domain. We can just then quote from 14] the 
values of 7 = 0.41269, and 9 = 0.42311. We should note 
at this point that while the exponents and the scaling 
functions p\ and mi appear to be universal, the functions 
Po andp 2 , apart for their small argument part, are system 
specific and non universal. 

Random Linear Programming The replicated entropy 
of the RLP model is very similar to the one of the per- 
ceptron, indeed formula © is substituted by: 


nS[Q ] = -tr log Q + (29) 
a log ( e 2 ^abA+Qo-^ ah a ah b J~~J' Q(ji a — 

V a / h a = 0 

with the important difference that here since there is no 
spherical constraint the diagonal value of Q a b , Qaa = 
q = jj x i 2 a variational parameter to be deter¬ 
mined by the saddle point equations. Since the problem 
is convex replica symmetry always holds, and 


S = 


log (<? - q) 


q 


a / D a+q y log H 


q-q 

n-y 

Vq-q 


(30) 


in the jamming limit in which A = q — q — 0, S should 
not diverge faster than log A. Expanding S in A we have 


S. 


1 

2A 


(31) 


q - a J Da+qy (y - k) 2 9(k - y ) 

both this term and its ^-derivative should vanish; we get 

0 = q - a J D a+q y (y - k) 2 9(k - y) 

0 = 1 - a J D a+q y 9(k - y) 


) 2 6{K-y) 

(32) 

y), 

(33) 


which have a finite q and k solution if a > 2. Eq. O is 
the RS version of the condition of marginal stability (flU) 
and implies isostaticity. From an explicit computation 
one sees that the field distribution is given by 

g(r) = S(r ) + p -(r+ K ) 2 / 2 (a+ q ) Q(r y ( 34 ) 

vw + ?) 

















We see that the solution is marginally stable and iso¬ 
static, but g{r) is regular in the origin. The singu¬ 
lar behaviour of g(r) appears critically associated to 
replica symmetry breaking. This requires an interpre¬ 
tation which is at present lacking. 

Stability Bound It is possible to obtain the relation 
between the force and the gap exponents 7 > 1/(2 + 9) 
in the perceptron, generalising the argument of stability 
used by Wyart in hard spheres To this aim let us note 
that for fixed a the maximisation of n on the sphere with 
fixed x 2 is equivalent to the dual optimisation problem of 
finding an the maximum (resp. minimum) value in free 
space R n of x 2 at fixed value of n negative (resp. pos¬ 
itive). Let us consider the most interesting case k < 0. 
The core of the argument is that in isostatic configura¬ 
tions, in absence of small enough gaps one could increase 
the value of x 2 just by following the ’floppy mode’ that 
ensue from the opening of a contact; stability then re¬ 
quires that small forces be in correspondence with small 
enough gaps. 

The maximisation of x 2 under the perceptron con¬ 
straints can be performed introducing Karush-Kuhn- 
Tucker multipliers F M (forces) and the objective function: 

a N 

L(x) =x 2 + ^i^[— x-^-k], (35) 

1 ^ 

The first order maximisation conditions read: 


-^=(x + <5x) • = k + s, while keeping the remaining 

contacts binding: 


<Sx-f" 

Vn 


sS^s for n = l 


(37) 


Eq. (1371) has a unique solution and implies that each of 
the Sxi for i = 1, ...,N is of order s. Using (1361371) . the 
variation of x 2 , Ax 2 = 2x-dx+(<5x ) 2 can be then written 
as 


Ax 2 = —F 1 s + ANs 2 (38) 

where A is a constant of order 1 . Notice that Ax 2 < 0 
for small s, while it changes sign for s = s* = F 1 /(AN). 
The maximum is stable if before reaching that point, a 
new contacts forms, that prevents further maximisation 
of x 2 . At this point the argument proceeds verbatim as 
in [jj, we reproduce it here just for completeness. The 
less restrictive assumption one can make on the force 
distribution is the presence of a power singularity P(F) ~ 
F s , which implies F 1 = F m i n ~ A _T +A Opening the 
weakest contact would therefore imply a growth in x 2 if 
s > s* ~ However, a new contact is formed 

and blocks the floppy mode at a value of s of the order of 
fmin the minimum gap in the system. Stability requires 
therefore r m i n /)s*. Consequently, the distribution g(r) 
should be power law in the origin g(r) ~ r 1 in such 
a way that r m j n ~ A _ ~^A _ 1 _T Te. The inequality 
7 > 1/(2 + 9) follows readily. Two facts should be noted: 


r)T 1 

S- = 2 - + 7fE^ = 0. (36) 

In an isostatic maximum, there are N positive forces 
F^ in correspondence with the binding constraints while 
all the others are zero. Let us suppose without loss 
of generality to renumber the constraints so that the 
0 < F 1 < F 2 < ... < F n while F^ = 0 for n > N, 
and study the effect of unbinding the first contact by an 
extent s. We change then x into x + Sx in such a way 


1. If k > 0 (a < 2) maximisation of n at fixed x 2 is 
dual (equivalent) to minimisation of x 2 at fixed n. 
In this case, the forces are negative, and both terms 
in (l38l) lead to an increase of x 2 . 

2. For the RLP n maximisation is by no means equiv¬ 
alent to x 2 maximisation. 

In both cases, small forces do not need to be compensated 
by the existence of small gaps and there is no necessarily 
a relation between the two distributions. 





